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IN THE CLAIMS : 

1. (Currently Amended) A method for controlling a computer using at least one video 
image of a plurality of video images, the method comprising: 

(a) capturing n video streams, n being an integer of at least two, the n video 
streams each comprising a plurality of video frames and each of the n video 
streams comprising video of a different user; 

(b) determining a location of an object in at least one of the n video streams; 

(c) controlling a program executing on the computer based on the location of the 
object; 

(d) combining , at a single computer, the n video streams with a user interface 
stream generated by [[the]] a computer operating system, thereby forming a 
composite video stream; 

(e) providing the composite video stream for display to each of the different users; 
and 

(f) displaying the composite video stream. 

2. (Previously Presented) The method of claim 1 wherein capturing n video streams 
includes receiving a live video signal of a user generated by a video camera. 

3. (Previously Presented) The method of claim 1 wherein capturing n video streams 
includes receiving a stored video signal from a video storage device. 

4. (Previously Presented) The method of claim 1 wherein determining the location an 
object in at least one of the n video streams includes: 

(a) searching for a predetermined color in one of the n video streams; 
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(b) in response to locating the predetermined color, identifying an occurrence of 
the predetermined color having the largest area; and 

(c) determining coordinates of the center of the occurrence of the predetermined 
color having the largest area. 

5. (Previously Presented) The method of claim 1 wherein controlling a program executing 
on the computer based on the location of the object comprises: 

(a) analyzing motion of the object in successive video frames to determine 
presence of a control event; and 

(b) controlling the program based on the control event. 

6. (Previously Presented) The method of claim 5 wherein each of the n video streams 
comprises an image of a different computer user, the object comprises an object 
associated with the user's hand, and the control event comprises a pointer movement 
event. 

7. (Previously Presented) The method of claim 5 wherein each of the n video streams 
comprises an image of a different computer user, the object comprises an object 
located in the user's hand, and the control event comprises a mouse click event. 

8. (Previously Presented) The method of claim 1 wherein combining the n video streams 
with the user interface stream generated by the computer operating system includes 
horizontally reversing frames of the n video streams to produce a mirror image of the 
frames of the n video streams. 

9. (Previously Presented) The method of claim 1 wherein combining the n video streams 
with the user interface stream generated by the computer operating system includes 
transparently overlaying the user interface stream on the n video streams. 
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1 0. (Previously Presented) The method of claim 1 wherein combining the n video streams 
with the user interface stream generated by the computer operating system includes 
transparently overlaying the n video streams on the user interface stream. 

1 1 . (Previously Presented) The method of claim 1 wherein combining the n video streams 
with the user interface stream generated by the computer operating system includes: 



(a) adjusting a transparency level of at least one of the user interface stream and 
the n video streams; and 

(b) generating the composite stream from the user interface stream and the n 
video streams. 

12. (Original) The method of claim 1 1 wherein adjusting the transparency level includes 
dynamically adjusting the transparency level. 

13. (Original) The method of claim 1 wherein displaying the composite video stream 
includes projecting the composite video stream. 

14. (Canceled) 

15. (Canceled) 

16. (Currently Amended) A method for combining a plurality of video images, each 
containing an image of a user, with a computer desktop interface, the method 
comprising: 

(a) capturing n video streams, n being an integer of at least two, each video 
stream comprising a plurality of frames and each video stream comprising 
video of a different user; 



(b) transparently combining , at a single computer, the n video streams with a 
computer desktop generated by [[the]] a computer operating system, thereby 
forming a composite video stream; 

(c) providing the composite video stream for display to each of the different users; 
and 

(d) displaying the composite video stream, wherein the composite image includes 
transparent images of the users displayed with the computer desktop. 



1 7. (Previously Presented) The method of claim 1 6 wherein capturing the n video streams 
includes receiving a live video signal generated by a video camera. 

18. (Previously Presented) The method of claim 16 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes horizontally reversing frames of the n video streams to produce a mirror 
image of the frames of the n video streams. 

19. (Previously Presented) The method of claim 16 wherein combining the n video 
streams with the user interface stream generated by the computer operating system 
includes: 

(a) adjusting a transparency level of at least one of the user interface stream and 
the n video streams; and 

(b) generating the composite stream from the user interface stream and the n 
video streams. 

20. (Original) The method of claim 19 wherein adjusting the transparency level includes 
dynamically adjusting the transparency level. 
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21. (Original) The method of claim 16 wherein displaying the composite video stream 
includes projecting the composite video stream. 

22. (Original) The method of claim 16 wherein displaying the composite video stream 
includes displaying the composite video stream on a non-projection computer display 
device. 

23. (Previously Presented) The method of claim 16 wherein displaying the composite 
video stream includes displaying a mirror image of each user with the desktop. 

24. (Previously Presented) The method of claim 1 6 comprising controlling objects on the 
desktop in response to movement of at least one of the user images. 

25. (Previously Presented) The method of claim 24 wherein controlling objects on the 
desktop includes moving objects on the desktop. 

26. (Previously Presented) The method of claim 24 wherein controlling objects on the 
desktop includes activating programs associated with objects on the desktop. 

27. (Previously Presented) The method of claim 16 wherein the desktop comprises the 
desktop of a computer local to at least one of the users. 

28. (Previously Presented) The method of claim 16 wherein the desktop comprises the 
desktop of a computer remote from at least one of the users. 

29. (Previously Presented) The method of claim 1 6 wherein each of the plurality of video 
streams includes an image of a different user. 

30. (Previously Presented) The method of claim 29 comprising controlling desktop objects 
in response to movement of user images in any of the video streams. 

31. (Currently Amended) A computer-readable medium having stored thereon a set of 
computer-executable instructions, the set of instructions comprising: 
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(a) n video stream capturing routines, n being an integer of at least two, each of 
the video stream capturing routines for capturing a different video stream, each 
video stream comprising a plurality of video frames and each video stream 
comprising an image of a different user; 

(b) a video frame analysis routine for determining a location of an object in at least 
some of the plurality of video frames; 

(c) a driver for controlling a program executing on the computer based on the 
location of the object; 

(d) a video compositing routine for combining , at a single computer, the n video 
streams with a user interface stream generated by [[the]] a computer operating 
system, thereby forming a composite video stream and for providing the 
composite video stream for display to each of the n users; and 

(e) a video display routine for displaying the composite video stream. 

32. (Previously Presented) The computer-readable medium of claim 31 wherein the user 
interface driving routine comprises: 

(a) instructions for searching for a predetermined color in at least one of the n 
video streams; 

(b) instructions for identifying an occurrence of the predetermined color having a 
largest area; and 

(c) instructions for determining the coordinates of the center of the occurrence of 
the predetermined color having the largest area. 

33. (Previously Presented) The computer-readable medium of claim 31 wherein the video 
compositing routine comprises: 
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(a) instructions for adjusting the transparency level of at least one of the user 
interface stream and the n video streams; and 

(b) instructions for generating the composite stream from the user interface stream 
and the n video streams. 

34. (Previously Presented) The computer-readable medium of claim 31 wherein the video 
compositing routine comprises instructions for horizontally reversing images of the n 
video streams to produce a mirror image of the images of the n video streams. 

35. (Currently Amended) A computer readable medium having stored thereon computer- 
executable instructions for performing steps comprising: 

(a) receiving n video images, n being an integer of at least two, each video image 
including video of a different computer user; 

(b) combining , at a single computer, the n video images with a computer desktop 
image; 

(c) providing the combined image for display to each of the different users; 

(d) displaying the combined image; 

(e) tracking a portion of at least one of the n video images in the combined image; 
and 

(f) manipulating objects in the desktop image based on the tracked portion. 

36. (Previously Presented) The computer readable medium of claim 35 wherein 
manipulating objects includes highlighting the objects. 

37. (Previously Presented) The computer readable medium of claim 35 wherein 
manipulating objects includes moving the objects. 
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38. (Previously Presented) The computer readable medium of claim 35 wherein 
manipulating objects includes activating programs associated with the objects. 

39. (Previously Presented) A computer system comprising: 

(a) a display device; 

(b) n video cameras for producing n video streams, n being an integer of at least 
two, each video stream including video of a different user; and 

(c) a processing unit operatively coupled to the display device and the n video 
cameras, wherein the processing unit is adapted to: 

(i) receive the n video streams, combine the n video streams into a 
composite video stream including the video of the different users and 
provide the composite video stream for display to the different users; 

(ii) determine a location of a predetermined object associated with a user 
in at least one of the plurality of video frames; and 

(iii) control execution of a program based on the location of the object. 

40. (Previously Presented) The system of claim 39 wherein the n video cameras are each 
positioned to produce a video stream including an image of a different user. 

41 . (Previously Presented) The system of claim 40 wherein the different users comprise 
collaborators in a distributed computer programming task. 

42. (Previously Presented) The method of claim 1 wherein the program comprises a 
collaborative desktop application. 

43. (Previously Presented) The method of claim 42 wherein the collaborative desktop 
application allows each user to control his or her own mouse pointer on a shared 
desktop. 



Serial No. 10/562,240 

44. (Previously Presented) The method of claim 1 wherein at least some of the users are 
in different locations and wherein the program comprises a distributed computer 
programming application. 

45. (Previously Presented) The method of claim 29 wherein the different users comprise 
collaborators in distributed computer programming task. 

46. (Previously Presented) The computer-readable medium of claim 31 wherein each of 
the n video streams comprises an image of a different user. 

47. (Previously Presented) The computer-readable medium of claim 46 wherein at least 
some of the users are in different locations. 

48. (Previously Presented) The computer-readable medium of claim 47 wherein the 
different users comprise collaborators in a distributed computer programming task. 

49. (Previously Presented) The computer readable medium of claim 35 wherein each 
video image includes an image of a different user. 

50. (Previously Presented) The computer readable medium of claim 49 wherein the 
different users comprise collaborators in a distributed computer programming task. 



